Experimental Philosophy and the Incentivisation Challenge: a Proposed Application of the Bayesian Truth Serum

Abstract A key challenge in experimental social science research is the incentivisation of subjects such that they take tasks presented to them seriously and answer honestly. If subject responses can be evaluated against an objective baseline, a standard way incentivising participants by rewarding monetarily as function their performance. However, area philosophy this mode not applicable participant cannot easily scored along true-false spectrum experimenters. We claim philosophers’ neglect claims unimportance about mechanisms surveys experiments has plausibly led poorer data quality worse conclusions drawn overall, potentially threatening programme long run. As solution this, we propose adoption Bayesian Truth Serum, incentive-compatible mechanism used economics marketing, designed for eliciting honest responding subjective designs answers are surprisingly common. argue Serum (i) adequately addresses issue incentive compatibility (ii) it should applied vast majority philosophy. Further, (iii) provide empirical application method, demonstrating its qualified impact on distribution number items outline guidance researchers aiming apply future specifying additional costs design steps involved.